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APPROXIMATIONS  IN  LP  AND  TCHEBYCHEFF  APPROXIMATIONS 


One  of  the  difficulties  of  the  analysis  of  Tchebycheff  approximations 
for  functions  of  several  variables  lies  in  the  fact  that  the  best  approximation 
is  not  always  unique  [Ref.  l] „   Consequently  it  can  be  useful  to  define  a 
reasonable  particular  unique  Tchebycheff  approximation.   In  Reference  1, 
J.  Ro  Rice  defines  a  unique  "strict  approximation,,  "  but  only  for  functions 
defined  on  a  finite  set„   In  this  report,  we  show  that  the  strict  approxima- 
tion is  the  limit  of  the  best  approximation  in  L  when  p  — >   «>„   Unfortunately, 
this  relation  does  not  help  to  solve  the  initial  problem,  since  we  shall  show 
an  example  of  a  continuous  function  of  two  variables  defined  on  a  rectangle 
such  that  the  best  linear  approximation  in  L  does  not  converge  for  p  ->   °°„ 


Approximations  on  a  finite  set. 

Let  F(x),  g  (x),  .  ..  g  (x)  be  functions  defined  on  the  finite  set 

E  =  -sxn,  . . .  x  r.  We  suppose  that  the  matrix  ||f.(x.)   has  the  rank  n. 
I  r  mj        "  1  j 

Using  the  same  notations  as  in  Reference  1,  for  any  set  of  parameters  a  ,  .  „ .  a  , 


n 
L(A,x)  =  E  a.g.(x)  =  [A,G(x)] 
i=l  1  X 


represents  an  approximation;  A  denotes  the  vector  of  components  a  ,  . „ .  a  ; 
G(x)  is  the  vector  of  components  g,  (x),  .  ..  g  (x);  [A,  G(x)]  is  the  scalar 
product  of  A  and  G(x).   r(A,x)  =  L(A,x)  -  f(x)  is  the  error  of  the  approximation, 

Tchebycheff  approximation.   L(A,x)  is  a  best  Tchebycheff  approximation,  if  the 
parameters  a  ,  ...  a  minimize  the  expression 

max   | r(A,x.  )  | 
1=1, . . .m 

Notations .   The  deviation  p  of  F(x)  relatively  to  G(x)  on  a  set  S  c  E  is  given 
by 

p  =  inf  max  |r(A,x)|  . 
A  x€S 
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Let  W  be  the  set  of  all  best  Tchebycheff  approximations  of  F(x)  relatively  to 
G(x)  on  S.   The  characteristic  set  R  of  F(x)  relatively  to  G(x)  on  S  is  the 
set  of  points  x£S  such  that  |r(A,x)|  =  P  for  all  approximations  L(A,x)eW„ 

Remark .    In  the  terminology  of  Reference  1,  R  is  the  set  of  all  "critical 
point  sets"  and  in  the  terminology  of  Reference  2,  R  is  the  union 
of  all  "cadres  maxima. " 

Lemma  1.   a)  W  is  non-void; 

b)  R  is  non-void; 

c)  if  for  a  given  approximation  L(A,x),  there  exists  a  point  xeR  such 

that  r(A,x)  ^  p,  then  max  |r(A,x)|  >  p. 

xeR 

For  the  proof  of  lemma  1,  see  Reference  2,  theorem  7° 


Strict  approximation.   The  strict  approximation  L(A  ,x)  is  defined  by  the 
following  construction:   let  P  ,  W ,    R  be  respectively  the  deviation,  the 


set  of  best  approximations,  the  characteristic  set  of  F(x)  relatively  to 

to  G(x)  on  E  =lx1,  . . .  x  r.   Let  s_  be  the  rank  of  the  set  of  vectors 
11  mj        1 

iG(x)  xeR-.  r   ;  (it  may  happen  that  s   =  0).   By  the  convexity  of  W  ,  if  xeR  , 

then  r(A,x)  =  e(x)p   for  all  L(A,x)eW  with  e  (x )  =  +1  independent  of  L(A,x)„ 
Consequently,  W  is  a  subset  of  the  solutions  of  the  system 


L(A,x)  -  F(x)  =  e(x)pv  x£R1 


(1) 


Now  we  consider  the  best  approximations  of  F(x)  relatively  to  G(x)  on  E  -  R  , 
but  subject  to  the  condition  (l)„   Since  (l)  has  the  rank  s  ,  we  can  eliminate 


sn  parameters,  let  us  say  a     , , 
1  m-s  +1 


a  ;    the  approximations  take  the  form 
m 


m-s  +1 

L(2)(A,x)  =    Z   a.g(2)(x) 
i=l 


(2) 
and  the  new  problem  is  to  approximate  F(x)  by  L   (A,x)  on  E  -  Rn  .   Let 

G(2)(x)  =  (g{2)(x), 


(2) 
I  -,(x))  and  p  .  VL,  R^  be  respectively  the  deviation, 

m-s,+lv  '  2'      2*    2 


the  set  of  best  approximations,  the  characteristic  set  of  F(x)  relatively  to 
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(2 )  f  (2 )        1 

G   (x)  on  E  -  1;  s   is  the  rank  of  the  set  of  vectors  iG   (x)  xeR  r.   It  is 

clear  that  P  <  P  and  W  C  W  .   We  show  that  p  <  p  ;  suppose  P  =  p  ;    then 
any  approximation  of  W  belongs  also  to  W  and  W  c  W ;  by  a  previous  relation 
W  =  W  and  R  c  R  which  is  a  contradiction  by  lemma  lb,   W  is  a  subset  of 
the  solutions  of  the  system 

L(2)(A,x)  -  F(x)  =  e(x)p2,  xeR2  (2) 


where  e(x)  =  +1  is  such  that  (2)  is  verified  for  an  approximation  L(A,x)eW  . 

We  consider  the  best  approximations  of  F(x)  relatively  to  G(x)  on 

E  -  R  -  R  ,  but  subject  to  the  conditions  (l)  and  (2).   With  the  help  of  (2) 

we  can  eliminate  s^  new  parameters,  let  us  say  a        ,  .  ...  a     and  the 

2  n-s  -s  +1'  n-s 

new  approximations  are  of  the  form 


n-s1-s2 

L(3)(A,x)  =    Z   a  g(3)(x); 
1=1 

(3) 
the  new  problem  is  to  approximate  F(x)  by  L   (A,x)  on  E  -  R  -  R  . 

Clearly,  we  can  continue  inductively  this  process  and  get  the 
sequences  p  >  p  ,  .  ..  >  p  ,  L^^A.x)  =  L(A,x),  L^2{A,x),  . ..  L^k^(A,x), 
R  ,  R  ,  . o ,    K,    until  s  +  s   +  . . .  +  s   =  n,   which  will  happen  once  since 
the  rank  of  the  matrix  ||g.(x  )|   is  n„   The  set  of  equations (l ),    (2)  ... 
will  define  a  unique  best  approximation  called  "strict  approximation . " 


Remark .    The  construction  of  the  strict  approximation  in  the  original  paper 
Reference  \,    is  slightly  different  but  entirely  equivalent. 

Approximation  in  L  .   L(A,x)  is  a  best  approximation  in  Lr  of  F(x)  on  a  set 
S  c  E  relatively  to  G(x)  if  the  parameters  a.  ,    ...a  minimize  the 
expression 

E  k(A,x)|P  . 
xes 


•3- 


Lemma  2.   a)   if  the  rank  of  the  vectors  -JG(x)  xeSr  is  n,  the 
unique  "best  approximation  in  L  for  p  >  1; 


?re  exists  a 


b)   If  the  rank  of  the  vectors  -sG(x) 


xeSr  is  t  <  n,  the  best  approxima- 


tions in  L  ,  p  >  1,  form  a  hyperplan  of  dimension  n  -  t;  if  L(A,x) 
and  L(A!,x)  are  two  best  approximations,  then  r(A,x)  =  r(A',x) 
for  x£S. 

For  the  proof  of  lemma  2a,  see  Reference  3j  Chapter  I.   Lemma  2b  is 

a  consequence  of  lemma  2a;  since  the  rank  of  the  matrix  of  elements  g.(x)  for 

xeS,  i  =  1,  ..on,  is  t,  there  exist  t  functions,  let  us  say  g  (x),  . ..  g,(x), 

such  that  the  rank  of  the  same  matrix  without  the  elements  corresponding  to 

i  =  t  +  1,  ...n  is  also  t;  let  L(A^x)  he  a  best  approximation;  there  exists  a 

t 
unique  approximation  of  the  form  L'(A',x)  =  Za'.g.(x)  such  that  L(A,x)  = 

i=l  1  ± 

L'(A',x)  for  xGS;  but  L'(A',x)  must  be  the  unique  best  approximation  of  F(x) 

by  g  (x),  ...  g ,  (x)  on  S;  consequently  L(A,x)  =  L'(A',x)  for  x€S  if  and  only 

if  L(A,x)  is  a  best  approximation  of  F(x)  by  g  (x),  ...  g  (x)  on  S;  the  lemma 

1  n 

2b  follows  immediately. 

Remark .   Let  1  <  p  <  pp  <  p_  ...  be  a  sequence  growing  to  infinity  and  L(A.,x) 
be  a  best  approximation  in  L   of  F(x)  on  S  c  E  relatively  to  G(x); 
it  is  rather  obvious  that  the  errors  r(A.,x)  for  xeS  are  bounded; 
consequently,  there  exists  a  subsequence  p.   such  that  lim  r(A.  ,x) 

exists  for  all  xeS. 

Theorem.   If  L(A  ,x)  and  L(A  ,x)  denote  respectively  the  strict  approximation 

and  the  best  approximation  in  L  of  F(x)  on  E  relatively  to  G(x),  then 


L(A  ,x)  =  lim  L(A  ,x)  . 
p-»oo    V 

Proof.    Let  R  ,  ...  R  be  the  characteristic  sets  defined  in  the  construction 
of  the  strict  approximation.   We  prove  by  induction  that  for  i  =  1,2,  ...  k 


lim  r(A  ,x)  =  r(A  ,x)  ,  xeR.  ; 

p-»oo      -^ 


-h- 


xeUR.  r   is  n, 


the  theorem  follows  immediately  since  the  rank  of  the  vectors  ^G(x) 

Let  K    =  ^L(A^   ,  x)r  be  the  set  of  the  best  approximations  of  F(x) 

i 
in  L  on  C.  =  U  R.  relatively  to  G(x).   In  the  i-cycle  of  induction,  we  shall 


j-i J 


also  prove  that 


( i  )  * 

lim  r(Avj;,x)  =  r(A  ,x)  ,  xeR.    for   J-i,  i+1,  . .  .k. 

p  '        '  1 

P  +  oo      * 


First  step:   suppose  that  for  an  element  x'eR 


lim  r(A  ,x'  )  £   r(A  ,x'),    (or  the  limit  does  not  exist); 
p+oo    * 


by  lemma  lc  and  the  remark  of  lemma  2,  there  exists  an  element  x£R  ,  a  number  z 
and  a  sequence  1  <  p  <  p   . . .  growing  to  infinity  such  that 

r(A  ,x)  >  z  >  p    for   j  =  1,2,  .,. 
J 

we  have  the  relations 


P  ■      P  •  P.P. 

Z  |r(A*,x)|  J  <  mp  J    and    Z   |r(A  ,x)|  J  >  z  J 
xeE  xeE     Pj 


where  m  is  the  number  of  elements  of  E,   There  exist  N  such  that  for  j  >  N 

P.P.  p. 

mp    <  z  J;  that  means  that  L(A  ,  x)  is  a  better  approximation  in  L   than 

L(A  ,x)  which  is  a  contradiction.   The  same  argument  can  be  applied  for 

L(A   ,x)  for  j  =  1,2, . ■ .k  by  replacing  in  the  above  equations  A  by  A^J   and 
P  P     P 

E  by  C..   We  have  the  results 

J 

lim  r(A  ,x)  =  r(A  ,x)  ,   x£R_,  =  C_  ; 
P  11 

p*oo      * 

lim  r(A^',x)  =  r(A*,x)  ,   xeR,  =  Cn  . 

V  1 

p-»<» 
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Second  step:   suppose  we  have  already  proved  that 


lim  r(A  ,x)   =  r(A  ,x)  ,   xec.^  ;  ^ 


P 


■♦00 


lim  r(A^^x)  =  r(A*,x)  ,   xe^^,   for  J  =  i-l,i,  ...k,      /^ 

p-»oo      ^ 


and  suppose  there  exists  an  element  x'eR.  for  which 


lim  r(A  ,x'  )  f   r(A  ,x'),    (or  the  limit  does  not  exist); 
p->°o    * 


by  lemma  lc,  equation  3j  and  the  remark  of  lemma  2,    there  exists  a  point  xeR., 
a  number  z  >  P.  and  a  sequence  1  <  p  <  p   ...  growing  to  infinity  such  that 

r(A  ,x)  >  z  >  P.    for   j  =  1,2...  (5) 

Let  us  define  the  distance  d(L(A,x),  L(A',x))  of  two  approximations  as  the 
euclidian  distance  between  the  vectors  A  and  A';  by  lemma  2b,  there  exists  a 

unique  approximation  L(A    "  ,  x)eK      which  is  the  closest  to  L(A  , x) 

among  all  elements  of  K     ;  by  3 


lim  L(A^1"l),x)  =  L(A*,x); 

p*oo      V 


there  exists  N  and  w  such  that  for  j  >  N 


r(A^1_   ,x)  <  w  <  z   for   xeE  -  C.  _: 
p.  l-l 

J 

using  this  relation  and  the  fact  that  L(A^     ,x)eK     ,  we  have 

pi        pi 


■6- 


E  Ir^1"1^)^  =   E   IrCA^x)^  +    E    |r(A^i-1>,x)|PJ 
xeE    pj  xeCi-i     J  xeE_Ci_i     J 


p.     p. 
<   E   |r(A  ,x)|  J  +  mw  J;  (6) 


by  (5): 


E  |r(A  ,x)|PJ  >   E    |r(A  ,x)|PJ  +  z?  J ;  (7) 

x£E    pj        xeC.      pj 


there  exists  M  >  N  such  that 


pi    Pi 
mw  J  <  z  J   for  j  >  M  (8) 


by  (6),  (7),  (8): 


.P.  .P 


E  |r(A(i_l),x|  j  <  E  |r(A  ,x)|  j    for  j  >  M, 


xeE    pj         xeE    pj 

P1 
which  contradicts  the  fact  that  L(A  ,x)  is  the  best  approximation  in  L   of 

Pj 

F(x)  on  E.   The  same  argument  can  be  applied  for  L(A   }x) ,    j  =  i^i+1, ...k  by 

(1)  P 

replacing  A  by  A   ,  E  by  'C .  .   We  have  the  desired  results: 

P     P  J 

lim  r(A  ,x)   =  r(A  ,x),      xeC.  ; 
p-»°° 

lim  r(A^J  ,x)  =  r(A  ,x),      xeC.,    for   j  =  i,  1+1,  .  .  .k. 

p-*°° 

A  disappointing  example. 

We  shall  define  a  continuous  function  F(x,y)  on  the  rectangle < 
-2  <  x  <  2,  -k  <   y  <  h     such  that  the  coefficients  of  the  best  approximation 
in  L  ax+by+c  do  not  converge  when  p  grows  to  infinity;  (an  example  of 
a  function  of  one  variable  with  approximations  of  the  form  ax  would  be  slightly 
simpler). 
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The  function  D(y)  is  clearly  defined  by  the  Figure  1  for  -k  <  y  <  k. 
The  function  G(x)  which  will  be  constructed  later  has  the  following  properties 
(Figure  3): 

1)  G(x)  is  defined  for  -2  <  x  <  2; 

2)  G(x)  is  increasing  for  -2  <  x  <  0,  decreasing  for  0  <  x  <  2; 

3)  G(-2)  =  G(2)  =  2;  G(0)  =  6; 
k)  G(x)  <  6  -  2  |x|; 


then 


min  (D(y),  G(x))   for   -k   <  y  <  -2  and  2  <  y  <  4; 


r   mm  [U{jj,    U{X.)J        ior   -4  <.   y  <  - 
F(x,y)=^  m£0C  (D(y)^  -g(-x))  for   -2  <  y  <  2 


in  other  words  Figure  1  and  Figure  2  represent  the  orthogonal  projection  of 
the  surface  z  =  F(x,y)  on  the  plans  (y, z)  and  (x,  z). 

Let  z  =ax+by+c  be  the  best  approximation  of  F(x,y)  in  L  . 
p    p     p     p  v  3J 

The  plan  z'   =  ax-by  +  c,  image  of  z  with  respect  to  the  plan  y  =  0,  is 
ppppp 

also  a  best  approximation;  since  the  best  approximation  is  unique  (cf  Reference  3 )} 

z  =  a  x  +  c  ;    furthermore,  the  approximation  z"  =  a  x  -  c  ,  image  of  z'   with 

P    P     P  P    P     P  P 

respect  to  the  line  x  =  0,  z  =  0,  is  also  a  best  approximation  and  therefore 

the  best  approximation  is  of  the  form  z  =  a  x.   The  equation 
/   dy  /   |F(x,y)  -  ax|P  dx  =  /   |g(x)  -  ax|P  (8  -  |  G(x))dx  =  l(-2,2,a,p,G(x)) 


reduces  the  problem  to  a  single  variable. 

The  function  G(x)  is  defined  by  recurrence;  at  the  k-step,  the 
quantities  u',  u  ,  l1,  1  ,  v1,  v  }    z' ,    z   ,    p%  p  will  be  determined;  they  will 
satisfy  the  relations 


u  =  -2;  v,     =  2;  z  =2; 

o     y      o    '     o 


uk-i  <  K  <  ui  <  v  <10) 
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Figure  1 
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Figure   3 
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>x 


G(x) 


1 
H 1- 


-< >*x 


Vi  >  vk  >  \  >  V 


6(k-l)  c  ,__  x 

Vi  <  zk  <  V  -k      <  zk  <  6'  (11) 


Vi<pk<pk'  pk>k^  (12) 


lim  xl     -   lim  v  =  0;  (13) 

k-»°°      k^oo 


zk  =  G(vk)  =  G(uk'  =  G(1k}' 


zk  -  G(vk)  .  G(uk)  -  G(l'+1); 


at  the  k-step,  G(x)  will  "be  defined  for  u  ,  <  x  <  u„  and  vn  <  x  <  v,  _,  such 

k-1  —   —  k      k  —   —  k-1 

that 

l(-2,2,l,p'  G(x))  <  l(-2,2,a,p'  G(x))   for  a  <  0„5;         (l*0 


l(-2,2,-l,pk,G(x))  <  l(-2,2,a,pk,G(x))  for  a  >  -0,5;        (15) 


the  equations  (l^-)  and  (15 )  prove  that  a^,  >  0»5^  a_  <  -0.5  and  consequently 
the  asserted  phenomenal  of  divergence . 


K  \ 


Construction,   Suppose  G(x)  constructed  for  -2  <  x  <  u,  ,  and  v,  ,  <  x  <  2; 
—   —  k-1      k-1  —   — 

let  \-i  =  (\-r  Zk-i^  Bk-i  =  (vk-i^  Zk-i)  and  s  =  (o'6^  (Fieure  3  J  we 

join  B    to  S  by  a  straight  line;  let  -a  be  its  slope  and  3  >  a,   such  that 

(a  +  0.5)  (^i-j  +  gij)  <  i   .  (16) 

Let  C'  =  (l' )    zn   )  be  the  intersection  of  the  straight  line  passing  by  S  of 
slope  (3  with  the  horizontal  line  z  =  z   ;  the  function  H(x)  is  equal  to  G(x) 
for  -2  <  x  <  u   ,  v    <  x  <  2  and  is  defined  by  the  polygon  A   C'SB    for 
uv   <  x  <  v   ;  p '  is  chosen  such  that 
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l(-2,2,l,p«  H(x))  <  1(0, v,  n,0.5,p;,H(x));  (lT) 


k-1 


let  for  z    <  c  <  6  the  function  M(x)  be  defined  by  the  relations 

rH(x)  for   H(x)  <  c; 
M(x)  =  {  c    for   H(x)  >  c; 

by  (IT)  it  is  clear  that  there  exists  a  value  c  for  which 

l(-2,2,l,p^,H(x))  <  l(0,vk_1,0„5,P^M(x))J  (18) 

then  z'  —  c;   AJ    =  (u' ,  z ' )  and  B'  =  (v' ,  z ' )  are  the  intersections  of  z  =  H(x) 
k       x     k'   k      k     kJ   k 

with  the  horizontal  line  z  =  z ! ,°  finally  G(x)  is  defined  as  H(x)  for  z  <  z', 

X  X 

i.e.,  for  -2  <  x  <  vJ    and  v '  <  x  <  2 »   We  shall  prove  later  that  the  choice 
of  p'  according  to  (l?)  is  possible  and  that  (lh)   follows  from  (17)  and  (l8). 

The  construction  of  the  second  part  of  the  step  of  induction  is 
analogous  to  the  first  one  and  will  be  described  briefly  only.   We  join  AJ    to  S 
by  a  straight  line;  let  5  be  its  slope  and  7  >  5  such  that 


(6+0.5)(74T+&-iT)<l; 


let  C  be  the  intersection  of  the  straight  line  passing  by  S  of  slope  -7  with 
the  horizontal  z  =  z';  p  and  z,  must  satisfy  equations  similar  to  (lT)  and 

(l8)  in  order  that  (15)  holds  (furthermore  in  order  that  lim  p  =  °°  and 

kk 

lim  z  =  6,    (ll)  and  (12)  must  be  verified).   Let  L(x)  be  equal  to  G(x)  for 
i     k 

-2  <  x  <  u'  and  v '  <  x  <  2  and  be  defined  by  the  polygon  A/SC  B'  otherwise. 

The  new  function  G(x)  is  now  defined  as  L(x)  for  L(x)  <  z  }   A,  =  (u  ,  z,  )  and 

B.  =  (v.  o  z,  )  are  the  intersections  of  z  =  L(x)  with  the  horizontal  z  =  zn  . 
k     k   k  k 

The  proof  that  for  p'  large  enough  (17)  holds  is  a  little  tedious 

and  will  be  given  only  briefly;  we  obtain  the  following  results  after  some 

computations : 

l(-2,2,l,p,H(x))  =  l(-2,l^,l,p,H(x))  +  l(l^,0,l,p,H(x)) 

+  l(0,vk_1,l,p,H(x))  +  l(vk_1>2,l,p,H(x)); 
-11- 

'RSITY  Of- 


l(-2,l^l,P,H(x))  +  I(v   ,2,l,P,H(x))  <  32wP; 


V  '*'    v  "         N  k-1 


k      6P+1        Kl 

k^o,i,p,h(x))  <  (p  +  ;)(p ,  l7  (i  +  j-^u 


k   •   6P+1        K2 

i(o,Vi,i,p,h(x))  <  (p  +  l)(a  +  1}-  (i  +  p-^); 


I(0>Vl,0.5,p,H(x))  >  (p  Ai(a  +  037  (1  -  K3  (I)P  -  p-h  <|)P) 

where  w  =  3  +  0-5  z     <  6  (by  equation  (9))  and  K  ,  K~^  K  ,    K,  are  independent 
of  p;  combining  these  last  relations^  we  have 

1(0,^^,0. 5, P,H(x))  -  l(-2,2,l,p,H(x)) 

>-  (P  +  i)(a6!  0.17  i1 "  (a  +  °-5)(^"i +  ^tt'  "  rh  (Qi +  Vl>P> 

-K3(|)P  -  (fe(p  +  1)(|)P}  . 

where  Q^  and  Q,  are  independent  of  p;  by  (l6),  for  p  large  enough^  the  right 
hand  side  is  positive,,  which  proves  (l7)° 

It  remains  only  to  prove  (l^-).   Clearly  by  construction  the  following 
inequality  is  valid 

M(x)  <  G(x)  <  H(x); 

we  deduce  immediately  the  relations  1 

1(0,^.^0. 5,p^,M(x))  <  l(-2,2,a,p^,G(x))   for  a  <  0.5}  (19) 

l(-2,2,l,p£,G(x))  <  l(-2,2,l,p^H(x));  (20) 

(l^)  is  an  immediate  consequence  of  (l8),  (19)^  (20 ). 
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